Papers with fluency metrics
Evaluating Readability Metrics for German Medical Text Simplification (2025.coling-main)
Copied to clipboard
| Challenge: | Clinical reports and scientific information sources are written for medical experts, preventing patients from understanding the main messages of these texts. |
| Approach: | They evaluated the suitability of 18 statistical, part-of-speech-based, syntactic, semantic and fluency metrics to measure readability of German medical texts. |
| Outcome: | The proposed measures are compared with standard methods on English medical texts and simplified summaries. |
A Benchmark Corpus for the Detection of Automatically Generated Text in Academic Publications (2022.lrec-1)
Copied to clipboard
| Challenge: | Automated text generation has achieved performance levels that make the generated text almost indistinguishable from those written by humans. |
| Approach: | They propose to use a completely synthetic dataset and a partial text substitution dataset to evaluate the quality of the generated research content. |
| Outcome: | The proposed datasets compare the generated texts to aligned original texts using fluency metrics such as BLEU and ROUGE. |
TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text style transfer rely on few-shot capabilities of large language models or complex controllable text generation approaches that are inefficient and underperform on fluency metrics. |
| Approach: | They propose a lightweight but effective approach which leverages a small language model and pre-trained authorship embeddings to perform efficient, few-shot text style transfer. |
| Outcome: | The proposed method outperforms strong approaches such as GPT-4 and performs form attribute style transfer with automatic and human evaluations. |